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DEVICE AND PROCESS FOR USE IN ENCODING AUDIO DATA 
BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a device and process for use in encoding 
5 audio data, and in particular to a psychoacoustic mask generation process for MPEG audio 
encoding. 

Description of the Related Art 

The MPEG-1 audio standard, as described in the International Standards 
Organisation (ISO) document ISO/IEC 1 1 172-3: Information technology - Coding of 
10 moving pictures and associated audio for digital storage media at up to about 1.5Mbps 
(“the MPEG-1 standard”), defines processes for lossy compression of digital audio and 
video data. The MPEG-1 standard defines three alternative processes or “layers” for audio 
compression, providing progressively higher degrees of compression at the expense of 
increasing complexity. The second layer, referred to as MPEG-1-L2, provides an audio 
15 compression format widely used in consumer multimedia applications. As these 

applications progress from providing playback only to also providing recording, a need 
arises for consumer-grade and consumer-priced devices that can generate MPEG-1-L2 
compliant audio data. 

The reference implementation for an MPEG-1-L2 encoder described in the 
20 MPEG-1 standard is not suitable for real-time consumer applications, and requires 

considerable resources in terms of both memory and processing power. In particular, the 
psychoacoustic masking process used in the MPEG-1-L2 audio encoder referred to uses a 
number of successive and processing intensive power and energy data conversions that also 
incur a repeated loss in precision. 

25 Accordingly, it is desired to address the above or at least provide a useful 

alternative. 
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BRIEF SUMMARY OF THE INVENTION 

In accordance with one embodiment of the present invention there is 
provided a mask generation process for use in encoding audio data, including: 
generating linear masking components from said audio data; 

5 generating logarithmic masking components from said linear masking 

components; and 

generating a global masking threshold from the logarithmic masking 

components. 

One embodiment of the present invention also provides a mask generation 
10 process for use in encoding audio data, including: 

generating respective masking thresholds from logarithmic masking 
components using a masking function of the form: 

vf = -1 7 * dz, 0 < dz < 8 

One embodiment of the present invention also provides a mask generation 
1 5 process for use in encoding audio data, including: 

generating a global masking threshold from logarithmic masking 
components according to: 

LT g (i)=max[LT g (i)+ maxj =l {LT lonal [z(j),z{i)} + mw. n J=l {LT n0lse [z(j), z{i)]}\ 

where i and j are indices of spectral audio data, z(i) is a Bark scale value for spectral line 
20 i, LT, ona i[z(j), z(i )] is a tonal masking threshold for lines i and j, LT tonai [z(j)^(i)] is a non- 
tonal masking threshold for lines i and j, m is the number of tonal spectral lines, and n is 
the number of non-tonal spectral lines. 

Another embodiment of the present invention also provides a mask 
generator for an audio encoder, said mask generator adapted to generate linear masking 
25 components from input audio data, logarithmic masking components from said linear 
masking components; and a global masking threshold from the logarithmic masking 
components. 
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Another embodiment of the present invention also provides a 
psychoacoustic masking process for use in an audio encoder, including: 

generating energy values from Fourier transformed audio data; 
determining sound pressure level values from said energy values; 

5 selecting tonal and non-tonal masking components on the basis of said 

energy values; 

generating power values from said energy values; 

generating masking thresholds on the basis of said masking components and 
said power values; and 

1 0 generating signal to mask ratios for a quantizer on the basis of said sound 

pressure level values and said masking thresholds. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Preferred embodiments of the present invention are hereinafter described, by 
way of example only, with reference to the accompanying drawings, wherein: 

1 5 Figure 1 is a block diagram of a preferred embodiment of an audio encoder; 

Figure 2 is a flow diagram of a prior art process for generating masking 

data; 

Figure 3 is a flow diagram of a mask generation process executed by a mask 
generator of the audio encoder. 

20 DETAILED DESCRIPTION OF THE INVENTION 

As shown in Figure 1, an audio encoder 100 includes a mask generator 102, 
a filter bank 104, a quantizer 106, and a bit stream generator 108. The audio encoder 100 
executes an audio encoding process that generates encoded audio data 1 12 from input 
audio data 110. The encoded audio data 112 constitutes a compressed representation of the 
25 input audio data 110. 

The audio encoding process executed by the encoder 1 00 performs encoding 
steps based on MPEG-1-L2 processes described in the MPEG-1 standard. The time-domain 
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input audio data 1 10 is convened into sub-bands by the filter bank 104, and the resulting 
frequency-domain data is then quantized by the quantizer 106. The bitstream generator 
108 then generates encoded audio data or bitstream 112 from the quantized data. The 
quantizer 106 performs bit allocation and quantization based upon masking data generated 
5 by the mask generator 102. The masking data is generated from the input audio data 110 
on the basis of a psychoacoustic model of human hearing and aural perception. The 
psychoacoustic modeling takes into account the frequency-dependent thresholds of human 
hearing, and a psychoacoustic phenomenon referred to as masking, whereby a strong 
frequency component close to one or more weaker frequency components tends to mask, 

10 the weaker components, rendering them inaudible to a human listener. This makes it 

possible to omit the weaker frequency components when encoding audio data, and thereby 
achieve a higher degree of compression, without adversely affecting the perceived quality 
of the encoded audio data 1 1 2. The masking data comprises a signal-to-mask ratio value 
for each frequency sub-band. These signal-to-mask ratio values represent the amount of 
15 signal masked by the human ear in each frequency sub-band. The quantizer 106 uses this 
information to decide how best to use the available number of data bits to represent the 
input audio signal 110. 

In known or prior art MPEG-1-L2 encoders, the generation of masking data 
has been found to be the most computationally intensive component of the encoding 
20 process, representing up to 50% of the total processing resources. The MPEG-1 standard 
provides two example implementations of the psychoacoustic model: psychoacoustic 
model 1 (PAM1) is less complex and makes more compromises on quality than 
psychoacoustic model 2 (PAM2). PAM2 has better performance for lower bit rates. 
Nonetheless, quality tests indicate that PAM1 can achieve good quality encoding at high bit 
25 rates such as 256 and 384 kbps. However, PAM1 is implemented in floating point 

arithmetic and is not optimized for chip-based encoders. As described in G.A. Davidson et. 
al.. Parametric Bit Allocation in a Perceptual Audio Coder, 97th Convention of Audio 
Engineering Society, November 1994, it has been estimated that PAM1 demands more than 
30 MIPS of computing power per channel. 
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Moreover, despite using the C double precision type throughout, the ISO 
implementation uses an extremely large number of arithmetic operations, each resulting in 
a loss of precision at each step of the psychoacoustic masking data generation process. 

The psychoacoustic mask generation process 300 executed by the mask 
5 generator 1 02 provides an implementation of the psychoacoustic model that maintains 
quality whilst significantly reducing the computational requirements. 

In order to most clearly describe the advantages of the psychoacoustic mask 
generation process 300, the steps of the process are described below with reference to a 
prior art process 200 for generating psychoacoustic masking data, as described in the 
10 MPEG-1 standard. 

In the described embodiment, the audio encoder is a standard digital signal 
processor (DSP) such as a TMS320 series DSP manufactured by Texas Instruments. The 
audio encoding modules 1 02 to 1 08 of the encoder 1 00 are software modules stored in the 
firmware of the DSP-core. However, it will be apparent that at least part of the audio 
15 encoding modules 102 to 108 could alternatively be implemented as dedicated hardware 
components such as application-specific integrated circuits (ASICs). 

As shown in Figures 2 and 3, both the psychoacoustic mask generation 
process 300 and the prior art process 200 for generating masking data begin by Hann 
windowing the 512-sample time-domain input audio data frame 1 10 at step 204. The Hann 
20 windowing effectively centers the 512 samples between the previous samples and the 

subsequent samples, using a Hann window to provide a smooth taper. This reduces ringing 
edge artifacts that would otherwise be produced at step 206 when the time-domain audio 
data 1 1 0 is converted to the frequency domain using a 1 024-point fast Fourier transform 
(FFT). At step 208, an array of 512 energy values for respective frequency sub-bands is 
25 then generated from the symmetric array of 1024 FFT output values, according to: 

e M = \ x ( n t = x\ («)+ x? («) 

where X(n)= Xn(ri)+ iXfji ) is the FFT output of the nth spectral line. 
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In this specification, a value or entity is described as logarithmic or as being 
in the logarithmic-domain if it has been generated as the result of evaluating a logarithmic 
function. When a logarithmic value or entity is exponentiated by the reverse operation, it is 
described as linear or as being in the linear-domain. 

5 In the prior art process 200, the linear energy values E(n ) are then converted 

into logarithmic power spectral density (PSD) values P{ri) at step 210, according to 
P(«)=101ogio£(n), and the linear energy values E{n) are not used again. The PST) values 
are normalized to 96 dB at step 212. 

Steps 210 and 212 are omitted from the mask generation process 300. 

10 The next step in both processes is to generate sound pressure level (SPL) 

values for each sub-band. In the prior art process, an SPL value L S b(n) is generated for each 
sub-band n at step 214, according to: 

L sb («) = MAX\_X spl («), 20 * log (scf max («) * 32768) - 1 0 JdB 
and 

15 '^,/M = 10*log lo f£lO* ( * |, ' 0 ldB 

V k J 

where scf max (n ) is the maximum of the three scale factors of sub-band n within an MPEG1 
L2 audio frame comprising 1152 stereo samples, X{k) is the PSD value of index k, and the 
summation over k is limited to values of k within sub-band n. The “-1 0 dB” term corrects 
for the difference between peak and RMS levels. 

20 Significantly, the prior art generation of SPL values involves evaluating 

many exponentials and logarithms in order to convert logarithmic power values to linear 
energy values, sum them, and then convert the summed linear energy values back to 
logarithmic power values. Each conversion between the logarithmic and linear domains is 
computationally expensive and degrades the precision of the result. 

25 In the mask generation process 300, L s b{ri) is generated at step 302 using the 

same first formula for L s b(n), but with: 
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^ W = 10 * log, J 2 A- w) + 96dB 



where X(k) is the linear energy value of index k. The “96 dB” term is used to normalize 
L s b{ri). It will be apparent that this improves upon the prior art by avoiding exponentiation. 
Moreover, the efficiency of generating the SPL values is significantly improved by 
5 approximating the logarithm by a second order Taylor expansion. 

Specifically, representing the argument of the logarithm as Ipt, this is first 
normalized by determining x such that: 

Ipt = (l - x)2 m , 0.5 < 1 - x < 1 

Using a second order Taylor expansion, 

10 ln(l - x) ~ -x - x 2 / 2 

the logarithm can be approximated as: 

lo gio (ty) * [»* * ln(2)- (x + x 2 / 2)]* log 10 (e) 

= [m * ln(2)~ (x + x * x * 0.5)]* log 10 (e) 

Thus the logarithm is approximated by four multiplications and two 
additions, providing a significant improvement in computational efficiency. 

1 5 The next step is to identity frequency components for masking. Because the 

tonality of a masking component affects the masking threshold, tonal and non-tonal (noise) 
masking components are determined separately. 

First, local maxima are identified. A spectral line X(k) is deemed to be a 
local maximum if 

20 X(jfc)>2f(yfc-l)and *(*)>*(* + 1) 

In the prior art process 200, a local maximum X(k) thus identified is selected 
as a logarithmic tonal masking component at step 216 if: 

X(k)-X(k + j)> 7dB 

where y is a searching range that varies with k. If X(k) is found to be a tonal component, 

25 then its value is replaced by: 
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^wW = 101og IO (lO- ( *- )/, ° -HO^' 10 + 10^ +, ) /10 ) 

All spectral lines within the examined frequency range are then set to 

- co dB. 

In the mask generation process 300, a local maximum X(k ) is selected as a 
5 linear tonal masking component at step 304 if: 

A^IO - 07 >X(k + j) 

If X{k) is found to be a tonal component, then its value is replaced by: 

x lmt (k)=x(k-\)+x(k)+x(k+\) 

All spectral lines within the examined frequency range are then set to 0. 

10 The next step in either process is to identify and determine the intensity of 

non-tonal masking components within the bandwidth of critical sub-bands. For a given 
frequency, the smallest band of frequencies around that frequency which activate the same 
part of the basilar membrane of the human ear is referred to as a critical band. The critical 
bandwidth represents the ear’s resolving power for simultaneous tones. The bandwidth of 
1 5 a sub-band varies with the center frequency of the specific critical band. As described in 
the MPEG-1 standard, 26 critical bands are used for a 48 kHz sampling rate. The non-tonal 
(noise) components are identified from the spectral lines remaining after the tonal 
components are removed as described above. 

At step 218 of the prior art process 200, the logarithmic powers of the 
20 remaining spectral lines within each critical band are converted to linear energy values, 
summed and then converted back into a logarithmic power value to provide the SPL of the 
new non-tonal component X noise (k ) corresponding to that critical band. The number k is the 
index number of the spectral line nearest to the geometric mean of the critical band. 

In the mask generation process 300, the energy of the remaining spectral 
25 lines within each critical band are summed at step 306 to provide the new non-tonal 
component X noise (k) corresponding to that critical band: 

*—(*)-£*(*) 

> k 
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for k in sub-band n. Only addition is used, and no exponential or logarithmic evaluations 
are required, providing a significant improvement in efficiency. 

The next step is to decimate the tonal and non-tonal masking components. 
Decimation is a procedure that is used to reduce the number of masking components that 
5 are used to generate the global masking threshold. 

In the prior art process 200, logarithmic tonal components X tona fk) and non- 
tonal components X noise (k) are selected at step 220 for subsequent use in generating the 
masking threshold only if: 

W a LT, (*) or ( k)>LT q (k) 

1 0 respectively, where LT q (k) is the absolute threshold (or threshold in quiet) at the frequency 
of index k, threshold in quiet values in the logarithmic domain are provided in the MPEG-1 
standard. 

Decimation is performed on two or more tonal components that are within a 
distance of less than 0.5 Bark, where the Bark scale is a frequency scale on which the 
1 5 frequency resolution of the ear is approximately constant, as described in E. Zwicker, 
Subdivision of the Audible Frequency Range into Critical Bands, J. Acoustical Society of 
America, vol. 33, p. 248, February 1961. The tonal component with the highest power is 
kept while the smaller component(s) are removed from the list of selected tonal 
components. For this operation, a sliding window in the critical band domain is used with 
20 a width of 0.5 Bark. 

In the mask generation process 300, linear components are selected at step 

308 only if: 

X tonal {k)>LT q E{k) or X noise {k)> LT q E{k) 

where LT q E(k ) are taken from a linear-domain absolute threshold table pre-generated from 
25 the logarithmic domain absolute threshold table LT q (k ) according to: 

LT E{k) = io ,OE '°^(^ 96 > 10 
where the “-96” term represents denormalization. 
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After denormalization, the spectral data in the linear energy domain are 
converted into the logarithmic power domain at step 310. In contrast to step 206 of the 
prior art process, the evaluation of logarithms is performed using the efficient second-order 
approximation method described above. This conversion is followed by normalization to 
5 the reference level of 96 dB at step 212. 

Having selected and decimated masking components, the next step is to 
generate individual masking thresholds. Of the original 512 spectral data values, indexed 
by k, only a subset, indexed by i, is subsequently used to generate the global masking 
threshold, and this step determines that subset by subsampling, as described in the MPEG-1 
1 0 standard. 

The number of lines n in the subsampled frequency domain depends on the 
sampling rate. For a sampling rate of 48 kHz, n= 126. Every tonal and non-tonal 
component is assigned an index i that most closely corresponds to the frequency of the 
corresponding spectral line in the original (i.e., before sub-sampling) spectral data. 

1 5 The individual masking thresholds of both tonal and non-tonal components, 

LTionai and LT noise , are then given by the following expressions: 

LT ,cnal K i\ Z (0] = X tonal [*(/)] + ™ tonal K/)]+ Z (0] dB 

LT noise [ Z {j\ *(*)] = * noise [*(/)] + aV no,se [*(/)] + V f[ Z 0l *(0] dB 

where i is the index corresponding to a spectral line, at which the masking threshold is 
20 generated and j is that of a masking component; z(/) is the Bark scale value of the z th 

spectral line while z(j) is that of the y th line; and terms of the form X[z(j)] are the SPLs of 
the (tonal or non-tonal) masking component. The term av, referred to as the masking 
index, is given by: 

Atonal = -1.525 - 0.275 *z(/)- 4.5 dB 

25 av noise =-l-525-0.175*z(/)-0.5 dB 

v/is a masking function of the masking component and is characterized by different lower 
and upper slopes, depending on the distance in Bark scale dz, dz = z(i)-z(J) 
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In the prior art process 200, individual masking thresholds are generated at 
step 222 using a masking function vf given by: 

v/ = 17 * {dz + 1)- 0.4 * X[z{j)]~ 6 dB, for - 3 < dz < -1 Bark 
vf = {0.4* X\z(j^+ 6}* dz dB, for-1 <dz < 0 Bark 
5 vf = 17 *dz dB, for 0 < dz < 1 Bark 

vf = 17 * <£ + 0.15 * X\z{fft*{dz- 1) dB, for 1 < dz < 8 Bark 

where X\z(j)\ is the SPL of the masking component with index j. No masking threshold is 
generated if dz < -3 Bark, oxdz>% Bark. 

The evaluation of the masking function v/'is the most computationally 
10 intensive part of this step of the prior art process. The masking function can be categorized 
into two types: downward masking (when dz < 0) and upward masking (when dz > 0). As 
described in Davis Pan, A Tutorial on MPEG/ Audio Compression , IEEE Journal on 
Multimedia, 1995, downward masking is considerably less significant than upward 
masking. Consequently, only upward masking is used in the mask generation process 300. 
1 5 Moreover, further analysis shows that the second term in the masking function for 
1 < dz < 8 Bark is typically approximately one tenth of the first term, -\l*dz. 

Consequently, the second term can be safely discarded. 

Accordingly, the mask generation process 300 generates individual masking 
thresholds at step 312 using a single expression for the masking function vf as follows: 

20 vf = 17* dz, 0 < dz < 8 

This greatly reduces the computational load while maintaining good quality 
encoding. The masking index av is not modified from that used in the prior art process, 
because it makes a significant contribution to the individual masking threshold LT and is 
not computationally demanding. 

25 After the individual masking thresholds have been generated, a global 

masking threshold is generated. 
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In the prior art process 200, the global masking threshold LT^i ) at the 
frequency sample is generated at step 224 by summing the powers corresponding to the 
individual masking thresholds and the threshold in quiet, according to: 



LT g(0 = lGlog IO 



io^ (,)/1 ° +£ 1 o ir -[^(')i / 1 o+.J; 1 o 

>1 y=i 






* 0M')1 
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5 where m is the total number of tonal masking components, and n is the total number of 
non-tonal masking components. The threshold in quiet LT q is offset by -12 dB for bit rates 
> 96 kbps per channel. 

It will be apparent that this step is computationally demanding due to the 
number of exponentials and logarithms that are evaluated. 

10 In the mask generation process 300, these evaluations are avoided and 

smaller terms are not used. The global masking threshold LT^J) at the z -th frequency sample 
is generated at step 314 by comparing the powers corresponding to the individual masking 
thresholds and the threshold in quiet, as follows: 

LT g (z) = max[l7;(/)+ max; =I {LT lonal [z(y),z(/)]}+ max” =1 {LT n0ise [z{j\ z(z)j] 



1 5 The largest tonal masking components and of non-tonal masking 

components are identified. They are then compared with LT q (i). The maximum of these 
three values is selected as the global masking threshold at the z th frequency sample. This 
reduces computational demands at the expense of occasional over allocation. As above, 
the threshold in quiet LT q is offset by -12dB for bit rates > 96 kbps per channel. 

20 Finally, signal-to-mask ratio values are generated at step 226 of both 

processes. First, the minimum masking level LT m \ n (ri) in sub-band n is determined by the 
following expression: 

LT mi n (n) = Min\_LT g (z)J dB; for /(/) in subband n, 

whereXO is the z th frequency line within sub-band n. A minimum masking threshold 
25 LT m i n (n ) is determined for every sub-band. The signal-to-mask ratio for every sub-band n 
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is then generated by subtracting the minimum masking threshold of that sub-band from the 
corresponding SPL value: 

The mask generator 1 02 sends the signal-to-mask ratio data SMR s b{n ) for 
5 each sub-band n to the quantizer 1 04, which uses it to determine how to most effectively 
allocate the available data bits and quantize the spectral data, as described in the MPEG-1 
standard. 

All of the above U.S. patents, U.S. patent application publications, U.S. 
patent applications, foreign patents, foreign patent applications and non-patent publications 
10 referred to in this specification and/or listed in the Application Data Sheet, are incorporated 
herein by reference, in their entirety. 

From the foregoing it will be appreciated that, although specific 
embodiments of the invention have been described herein for purposes of illustration, 
various modifications may be made without departing from the spirit and scope of the 
1 5 invention. Accordingly, the invention is not limited except as by the appended claims. 



13 




